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Coarse-graining complex dynamics: Continuous Time Random 
Walks vs. Record Dynamics. 
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PACS 02 . 50 . Ey - Stochastic processes 

PACS 89 . 75 . Da - Systems obeying scaling laws 

PACS nn.mm.xx - Fluctuation phenomena, random processes, and Brownian motion 

Abstract - Continuous Time Random Walks (CTRW) are widely used to coarse-grain the evo- 
lution of systems jumping from a metastable sub-set of their configuration space, or trap, to 
another via rare intermittent events. The multi-scaled behavior typical of complex dynamics is 
provided by a fat-tailed distribution of the waiting time between consecutive jumps. We first 
argue that CTRW are inadequate to describe macroscopic relaxation processes for three reasons: 
macroscopic variables are not self-averaging, memory effects require an all-knowing observer, and 
different mechanisms whereby the jumps affect macroscopic variables all produce identical long 
time relaxation behaviors. Hence, CTRW shed no light on the link between microscopic and 
macroscopic dynamics. We then highlight how a more recent approach, Record Dynamics (RD) 
provides a viable alternative, based on a very different set of physical ideas: while CTRW make 
use of a renewal process involving identical traps of infinite size, RD embodies a dynamical en- 
trenchment into a hierarchy of traps which are finite in size and possess different degrees of 
met a- stability. We show in particular how RD produces the stretched exponential, power-law and 
logarithmic relaxation behaviors ubiquitous in complex dynamics, together with the sub-diffusive 
time dependence of the Mean Square Displacement characteristic of single particles moving in a 
complex environment. 
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Introduction. — Statistical physics is largely about 
coarse-graining microscopic descriptions into macroscopic 
ones more closely related to experiments. Thermal relax- 
ation of 'glassy' systems is a case in point: Due to their 
large number of microscopic configurations from which a 
deterministic (zero temperature) trajectory never escapes, 
configuration space can be partitioned into catchments 
basins which, at finite temperature, retain trajectories for 
a lapse of time of finite and random duration. We refer to 
these basins as traps, to the time spent in them as wait- 
ing time and to the transitions between traps as jumps. 
Describing relaxation in terms of traps and jumps greatly 
reduces the number of variables and constitutes the first 
step of coarse-graining. Based on Continuous Time Ran- 
dom Walks (CTRW) [B{3], a well established approach 
further assumes that each jump brings the system back to 
the same situation, i.e. that the sequence of jumps con- 
stitutes a renewal process. Using a fat-tailed distribution 
for the waiting time, the multi-scaled relaxation behavior 
characteristic of complex systems can in many cases be ac- 



counted for. Nevertheless, a stationary renewal process is 
not a natural choice to describe the macroscopic changes 
occurring in e.g. non-stationary relaxation processes. 

As emphasized in the much touted weak ergodicity 
breaking scenario [4j[5] time and ensemble averages dif- 
fer for renewal processes involving fat-tailed waiting time 
distributions. This property is closely related to a well- 
known mathematical result of Sparre- Andersen [SI [7] by 
the fact that the number of jumps in the interval [0,i) re- 
mains a distributed quantity in the limit t — > oo. Hence, 
in a CTRW description macroscopic quantities have broad 
distributions even in the thermodynamic limit. A second, 
related, issue is related to the system size dependence of 
the average and variance of macroscopic observablcs. As 
we argue, both quantities must scale linearly with system 
size, but fail to do so in CTRW. Thirdly, the memory 
mechanism implied by CTRW requires an all-knowing ob- 
server and, lastly, the long-time tail of the waiting time 
distribution can hardly be justified in many applications. 
In summary, even though CTRW appear flexible and emi- 
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nently applicable, their use to model complex dynamics is 
a dubious endeavor. We argue below that Record Dynam- 
ics^!)) is a viable alternative which relies on a completely 
different physical picture and which avoids the problems 
affecting CTRW, technically because the jumps are there 
a Poisson process. 

A record in a time series is an entry larger (or smaller) 
than all the entries that precede it. Records have always 
been a popular topic, but a recent surge of interest in their 
statistical properties [8] seems motivated by the ongoing 
debate on climate change, which is accompanied by a num- 
ber of record breaking events. That thermal noise records 
have an impact in complex dynamics was proposed in a 
model study of Charge Density Waves. Over the years the 
same idea, which we now refer to as Record Dynamics, has 
found applications in condensed matter physics |10H13j . 
evolutionary biology |14j and the dynamics of ant soci- 
eties [13] . The term 'record' in RD signals that overcoming 
a record-sized dynamical barrier elicits a jump -henceforth 
in this connection termed quake — which brings the sys- 
tem from one trap to a new and previously unexplored 
trap. RD hence describes a process of entrenchment into 
a hierarchy of traps indexed by dynamical barriers of in- 
creasing size [TSUI]. Focusing on the temporal statistics 
and the macroscopic effects of the quakes, RD provides a 
coarse-grained description of glassy dynamics. 

Critique of CTRW. - The probability Pj (n, t) of n 
jumps in the time interval [0, t) and its first two moments 
are discussed below, using the letter s and a superim- 
posed tilde to denote the Laplace variable and the Laplace 
transform of a function, respectively. Central to the de- 
scription is the waiting time probability density (PDF) 
W(t). Whenever its average is finite, the exponential form 
W(t) = exp(— t/to)/ta is a natural choice and, we stress, 
a choice to which our critique does not apply. To model 
complex relaxation a 'fat-tailed' PDF lacking a finite av- 
erage 



w ® = r (f 



< a < 1, t>t , (1) 



is utilized. Through mathematical steps detailed further 
below, the average and variance of the number of jumps 
occurring in (0, t) are shown, asymptotically for large i, to 
be connected by the equation 
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where T is the gamma function. For a = 1, cr? (t) = (t) . 
Otherwise, in the large t limit, af(t) oc (i?(t) and since 
o~j(t)/ fij(t) then approaches a constant, the number of 
jumps retains a broad distribution in the same limit. As 
the same is true for time averages of quantities subordi- 
nated to the jumps but not for the corresponding ensem- 
ble averages, ergodicity is 'weakly' broken. In contrast, 
textbook statistical mechanics teaches us that macroscopic 



variables are invariably delta-distributed, including cases 
where broken ergodicity stems from a broken symmetry. 
To the best of the author's knowledge, no experimental 
evidence has ever contradicted this result. 

Since a single CTRW process cannot consistently de- 
scribe macroscopic relaxation, let us instead try N inde- 
pendent and simultaneous jumping processes, each sup- 
ported in one of N domains, a situation typical of spatially 
extended systems with short-ranged interactions. The av- 
erage and the variance of the number of jumps throughout 
the system are in this case both proportional to N, and 
Cj(t)/nj(t) oc N~ x / 2 hence vanishes for large N, taking 
weakly broken ergodicity along. This sounds reassuring, 
but, as we shall see, the memory behavior implied by the 
description requires an all-knowing observer. 

For any choice of W(t), renewal equations for the jump 
probability Pj(n,t), 



P s (n,t) 



Pj(0,t) = 1- W(t')dt', 
Jo 

are solved in the s domain by 



Pj(n-l,t')W(t-t')dt' ; 71 = 1,2.(3) 



(4) 



" 1 - W(s) 



(5) 



The average number of jumps, /Ltj(t) = X)fc°=o kPj(k,t) and 
the auxiliary quantity /Ltp_j(t) = X)fe°=o(^ 2 — ^)-^j(^)^) 
have then transforms 



MiO 3 ) = — ^TTTT and ^.j 2 -j(s) - 



s(l - W(s)) 



s \1- W{s) 



respectively. 

To derive Eq. ([5]), insert the small s expansion 

W(s) = l-(t 0S ) a + O( S a+1 ) 



(6) 



(7) 



of the Laplace transform of Eq. ([!) into Eq. ([3J. Inverting 
the outcome yields 



and 
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(9) 



ar(2a) \io. 

The result follows from (?f(t) = fJ,j(t) + fj,p_j(t) — fJ>f(i). 

If the jumps constitute the true clock of the dynamics, it 
is natural to describe their effect on relaxation as a Markov 
chain. The question is then how the properties of the latter 
affect the relaxation in the time domain. In general, the 
propagator of a Markov chain is a linear superposition of 
exponentially decaying modes, each of the form b n , where 
b < 1. The same is true for averages calculated using the 
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propagator. Without loss of generality, we now consider 
the time dependence g(b, t) corresponding to a single mode 
b n , which is obtained by averaging n over the probability 
Pj (n, t) that n jumps occur. In the Laplace domain this 
amounts to 



g(M = £pj(n, S )6" 



1 - W(s) 
3(1 -bW(s))' 



(10) 



If W(t) has a finite average to, expanding Eq. (|TU)) to low- 
est order, we find that the mode decays exponentially in 
time, with a time scale to/(l — b) diverging as expected 
for b — >• 1. We also note that since g(b, t) actually depends 
on b, the eigenvalue spectrum of the Markov chain mat- 
ters in the time domain. This hinges on the s term in the 
denominator and the tgs term in the nominator canceling 
out. The situation radically differs if W(s) = 1 — (tos) a 
with < a < 1. To leading order, Eq. (fTUf gives a term 
proportional to s" -1 , which in the time domain translates 
into a power-law decay whose exponent, —a, is indepen- 
dent of b. In other words, the value of the exponent a is 
unrelated to the dynamical effects of the jumps. 

Consider now the simple scaling description known as 
pure or full aging behavior, which approximately captures 
some aspects of memory behavior in glassy dynamics. Ac- 
cording to pure aging, certain macroscopic variables de- 
pend on the ratio 4-, e.g. in the thermoremnant magneti- 
zation of spin-glasses |12j , t > t w is the time counted from 
the initial thermal quench and i w is the time at which the 
external magnetic field is switched off. 

Knowing that the system has remained in the same trap 
up to time t w at which observations commence, the prob- 
ability density for exiting the trap at time t > t w is 



W R (t w ,t) 



W(t) 



(11) 



which is identical to the RD expression ([TT]) obtained be- 
low by a different route. Since all traps are equivalent in 
CTRW, the memory behavior implied by Eq. (TTTj) rests on 
the observer knowing when a trap is entered. This might 
be experimentally achievable if a single trap describes the 
whole system, a possibility however already discarded as 
unphysical. If, however, N independent processes unfold 
at the same time, the observer must track when every trap 
is accessed, a task hardly feasible in experiments. 

Dynamical hierarchies, records and marginal 
stability. — Upward rooted binary trees [TO1 IT5H2T] 

whose nodes and height respectively represent traps and 
their energy provide a convenient coarse-grained represen- 
tation of energy landscapes with multiple minima. In low 
temperature thcrmalization, the 'bottom' states of low- 
est energy are those mainly occupied, and gaining access 
to nodes not previously visited entails crossing an energy 
barrier of record magnitude. Hence, diffusion on a hierar- 
chical structure can be described in terms of RD. In the 
general case, a record-sized energy fluctuation does not 



suffice to elicit a quake, simply because there might be 
no barrier to cross. Marginal stability |18j further posits 
that the barriers successively crossed differ by a minuscule 
amount. In this limit every record-sized energy fluctuation 
leads to the crossing of a barrier and record-sized thermal 
fluctuations trigger quakes. The temporal statistics of the 
quakes occurring between t w and t >- t w is in this limit a 
Poisson process, whose average fj, q (t w , t) cx (ln(t) — ln(t w )) 
is independent of the temperature j9ll!4j. 

To generalize the above results to cases where energy 
barriers differ by a finite amount, consider that, in general, 



(t w , £) 



r(t')dt', 



(12) 



where r(t) is the quaking rate and where the form r(t) = 
a/t corresponds to the logarithmic behavior associated to 
marginal stability. The generalized form 



r(t) = at x 



< x < 1, 



(13) 



i) reduces to a/t for x = 0, ii) produces time- homogeneous 
behavior for x = 1 and, Hi) integrated with respect to 
time, yields 

M (t W) t ) = a 1 —^ d ^ f f(t) - f(t w ). (14) 
x 

Since, as later argued, a Poisson distribution still applies, 
a particle happening to reside in a trap at time t w leaves 
it at time t > i w with probability 



Po(*w,*)=exp(-/(t) + /(i w )). 



(15) 



In terms of the lag time A = t — t w (0 < A < 00) 
commonly used in lieu of t, the residence time R spent in 
a trap has PDF 



W R {t w ,A) 



dPoitw, t v 



dA 



aexp[— (t w + A) x -t x J} (i w + A) 
x 



(16) 



-1+x 



We note in passing that A is often denoted by r or by t 
in the literature, both usages unfortunately clashing with 
our present notation. For i« 1, one obtains 



(17) 



which is equivalent to the CTRW expression given by 
Eq. (TTJ). Importantly, the time scale parameter which is 
fixed in CTRW is simply the system age in RD. Secondly, 
Eq. (|17p contains a stretched exponential, and its simi- 
larity to W(t) is restricted to the limit x — > 0. Thirdly, 
the RD parameter a is positive but not a priori limited to 
the unit interval. For a single hopping process and in the 
limit x — > 0, if each barrier record triggers a quake, a = 1, 
otherwise < a < 1. In extended systems, where several 
independent hopping processes occur simultaneously, a is 
proportional to the size of the system, as we later argue. 
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According to Eq. (fTT)) , the average or characteristic time 
spent in a trap occupied (but not necessarily entered) at 
time t w is 

h(t w ) = a- 1 (-) exp(-t£)r(-, -tl), (18) 

where F(s, z) = J 00 exp(—y)y s ~ 1 dy is the incomplete up- 
per gamma function. As a check we note that to(t w ) = a -1 
for x = 1 and that in the limit x — > to(t w ) — > t w , for 
a > 1. In the same limit and for a < 1, the average is 
infinite, but t w still provides the characteristic time scale 
for the power-law decay implied by Eq. (|T7)) . 

Assume now that an application specific function / has 
been found such that the probability density for the oc- 
currence of a quake is uniform in the stretched observa- 
tion interval f(t) — f{t w ). Partitioning the interval into 
M subintervals, let p be the probability that a quake falls 
into any of these and note that the probability for n quakes 
occurring is the binomial B(p, n, M). In the relevant limit 
p — > 0, M — > oo and pM — >• // q , the binomial tends to a 
Poisson distribution, as claimed. 

Using a binary tree to coarse-grain an energy land- 
scape [T2], we just argued that RD dynamics arises in 
two ways: in the limit x — > 0, successive barriers increase 
marginally, records in the impinging noise induce barrier 
crossings and, on average, the typical number n m /x q of 
barriers crossed at time t is proportional to ln(i). The 
Arrhenius relation ln(i) oc b(n)/T where T is the temper- 
ature and b(n) is the height of the n'th barrier then im- 
plies b(n) oc Tn. If marginal stability is relinquished, i.e 
for x > 0, we find ln(/i q ) « ln(n(i)) cx xln(i) for t » t w , 
from which we infer that the size of the n'th barrier crossed 
is b(n) oc (T/x) ln(ra). 

The time dependence of a macroscopic quantity, say g, 
is calculated in RD by averaging its dependence g(n) over 
the probability of n quakes occurring in (t w ,t), i.e. 

g(t w , t) = £ g(n) ^%^ , (19) 

n=0 

where fi q (t w ,t) is given in Eq. ((T4)) . As a first example, 
assume g(n) = c(n = 0)6", where c expresses the initial 
condition and where b < 1. The stretched exponential 
behavior ubiquitous in glassy dynamics |22[|23j 

= c^e-*^* 1 -*) = c(t w )e-^-^^, 

(20) 

immediately follows. If g is a one-point average, c(t w ) = 

c(io)e _ ' w ' s and there is in reality only one time argu- 
ment i. In contrast, a two-point correlation function with 
c(i w = 1) truly depends on two arguments, as well known. 

Again using the lag time A = t — t w Eq. ([2U]) is recast, 
for A/t w < 1 into 

g{t w ,A)=c(t w )e-^tl, (21) 

an exponential decay with a characteristic time constant 
r(t w ) = afi_ b \ ■ A relaxation time increasing with system 



age is experimentally observed in colloidal systems [2"2"1l2"l] . 
The age dependence of the life-time of the exponential 
approximation given in Eq. (|21[) is not usually discussed, 
but follows nevertheless by the simple Taylor expansion 
given above. In the limit x — > 0, Eq. (|20[) reduces to the 
power-law 

g(t w , t) = c(t w ) — « c(tw) exp( ^- iA), 

(22) 

where the exponential approximation holds for A <§C t w . 
Anticipating a later observation, we now let // q be propor- 
tional to the system size TV of a macroscopic system via 
a = Na, where o is a new constant. Secondly, we treat 
b" = cxp(6n) as one mode of a relaxation process param- 
eterized by n in lieu of time. Of the N eigenvalues in the 
spectrum most will approach zero as N — > oo. A glance 
at Eq. O shows that only those for which b = 0(1/N) 
produce a macroscopic decay independent of N. If the 
decay of b with N is faster respectively slower than 1/N, 
the corresponding mode in the time domain either has a 
'frozen' constant value or immediately decays to zero in 
the large N limit. Note that the stretching exponent x is 
independent of system size, while the exponent — a(l — b) 
in Eq. (|22]) is only N independent if, as just discussed, 
b=0{l/N). 

In summary, simple and general RD arguments lead 
to dynamical behaviors common in complex systems: 
stretched exponential relaxation and power laws with pure 
aging scaling. The sub-diffusive behavior of a single par- 
ticle moving in a complex environment is discussed next. 

Subdiffusion. — Irreversible single particle jumps in 
complex environments, e.g. binary Lennard- Jones mix- 
tures in their glassy phase [5S] are indicative of collective 
configurational re-arrangements. The same is, we believe, 
true for single particle diffusion in a living cell, a problem 
which has recently been modeled using CTRW [55]. It is 
difficult to imagine how a living cell can contain the traps 
of infinite, or at least very large, spatial extension needed 
to produce a waiting time distribution with a long-time 
tail, especially considering that the diffusing particle and 
its enclosure have similar length scales. 

Experimental data for dense colloidal system [57] re- 
analyzed in [T3] show that single particle Mean Square 
Displacement (MSD) grow logarithmically, a property ex- 
plained in Ref. [13] using RD. This result, which corre- 
sponds to the limit x —> in Eq. (|2"3|) . suggests that sin- 
gle particles in general probe the local re-arrangements 
of their aging environment. This leads to sub-diffusion 
formulas rather similar to their CTRW counterparts. Dis- 
tinguishing between the two approaches can therefore be 
experimentally challenging, as it e.g. requires an analy- 
sis of higher moments and/or an explicit investigation of 
age dependencies via ensemble averages. To avoid convo- 
luted typography the same symbol is used for the moments 
of the particle position, irrespective of the method used. 
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Note however that CTRW formulas have one time argu- 
ment, while RD formulas mostly have two. 

After performing n independent jumps, each associated 
to a random additive position change Axi , a point particle 
is located at 



A» = ^Aa 



Assume for simplicity that the identically distributed Axi 
have vanishing odd moments and denote their second and 
fourth central moments by e 2 and €4, respectively. The 
form of these moments will depend on e.g. whether the 
particles move in a potential well, but the arguments below 
do not. 

After n jumps, the variance of the particle position or, 
cquivalcntly its MSD, is <j\(n) = ne^. Hence, 

°x(*) = A*j(*) e 2 and °x(tw,t) = A*q(t w ,*)e2 (24) 

for CTRW and for RD, respectively. Explicitly, using 
Eq. (|T4"]) . we find the sub-diffusive behavior 



' x 



(t w ,t) 



f . . ; 



-e 2 - 



(25) 



Note that if the first jump moment e\ differs from zero a 
formula of the same type holds for the average position. 
Writing for convenience t w = y and t = y + A, where A is 
the lag time, and expanding Eq. (|14j) to first order in A, 
we find 

a d{y x ) 



dy 



-A. 



(26) 



Experimentally, the variance is estimated using the time 
integral 



1 



c-A 



[X(y + A)-X(y)] 2 dy, 



(27) 

where t max is the largest observation time. This corre- 
sponds to averaging n q (y,y + A) with respect to y over 
the same time span. To first order in A, the time averaged 
particle MSD is then 



<4(A,t B 



—t^A 

2 m" 



for A < tr. 



(28) 



If, on the other hand, A t max , time averaging is of 
dubious value, and Eq. (|24[) directly implies 



<4(A)«-A*. 



(29) 



Taken together, Eqs. (J2HJ) and (EH) describe a cross-over 
of the MSD from a linear to a sub-linear time dependence, 
a behavior observed by Jeon et al. |26j in their experiments 
on lipid granules in an intracellular environment. These 
authors claim that their findings 'unanimously' point to 
CTRW as the mechanism behind sub-diffusive behavior, 
but as we just argued RD offers an alternative explanation. 



To better discriminate between CTRW and RD, con- 
sider the ratio B between the fourth and the squared sec- 
ond moment of X. Given n jumps, the fourth moment 
is 

A t x 4 ( rl ) = ne 4 + {n 2 ~ n ) e 2- (30) 



(23) Correspondingly in the time domain 



t \ 2q e 2 
H X A(t) «/ij(i)e 4 + ( - 1 



t J aT(2a) 



for CTRW and 



for RD. For CTRW, the ratio 



B{t) = 



H Xl {t) aT 2 {a) , e 4 1 



(<4W) 2 



r(2a) 



A»n(*) 



(31) 



(32) 



(33) 



approaches a ^2a) as t — !> 00. In the same limit, the RD 
expression 



B(t w ,t) = I 



(■1 



(34) 



approaches unity, independently of the exponent x. This 
difference offers an opportunity to discriminate between 
the two descriptions. Assuming that a salient event defin- 
ing the age of the system can be identified, a second pos- 
sibility is to investigate whether the particle MSD has an 
aging dependence by performing ensemble averages. This 
dependence is present in RD but not in CTRW. 

Discussion. — The eminent applicability of CTRW 
conceals a number of theoretical issues. Firstly, fat-tailed 
waiting time PDFs for spatially confined processes, such 
as diffusion in cellular environments are in general cur- 
tailed by finite size effects. Secondly, macroscopic vari- 
ables modeled with a single CTRW feature an unphysical 
lack of self-averaging. Finally, since memory in CTRW 
cannot be rooted in the unchanging physical properties 
of the traps visited, it must be rooted in the observer's 
awareness of the time at which a trap is entered. This 
knowledge is only available (in principle) if traps pertain 
to the entire system, the possibility already invalidated by 
the lack of self-averaging. 

Broadly speaking, RD has the same range of applica- 
tions as CTRW, but shares none of their problems: Res- 
idence times have, with a single exception, a finite aver- 
age which increases systematically with system age. This 
means that, in contrast to CTRW, macroscopic configu- 
rations contain information on the system' s age, a fact 
which naturally explains memory behavior in RD. Since 
quakes are a Poisson process, albeit of an unusual kind, 
subordinated physical quantities are always self-averaging. 
Using averages over the number of quakes, RD produces 
a wide ranging analytical description of glassy relaxation 
and of single particle diffusion in complex environments. 
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A hierarchical configuration space structure which now 
seems to find its way into macroeconomics |29j , was advo- 
cated long ago by H. Simon [55] as a defining property of 
complexity. Whenever such description applies, crossing 
record sized barriers triggers quakes. Conversely, analyz- 
ing the dynamical effects of record sized perturbations on 
the stability of a system, a procedure which can in prin- 
ciple be purely observational, provides important clues on 
the configuration space structure. This line of investiga- 
tion has great potential interest in complex dynamics and 
can benefit from a recent considerable interest in record 
statistics |S|. 
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